Optimal errors and phase transitions in high-dimensional generalized linear models
نویسندگان
چکیده
منابع مشابه
Phase Transitions, Optimal Errors and Optimality of Message-Passing in Generalized Linear Models
We consider generalized linear models where an unknown n-dimensional signal vector is observed through the successive application of a random matrix and a non-linear (possibly probabilistic) componentwise function. We consider the models in the high-dimensional limit, where the observation consists of m points, and m/n → α where α stays finite in the limit m,n → ∞. This situation is ubiquitous ...
متن کاملGeneralized orthogonal components regression for high dimensional generalized linear models
Here we propose an algorithm, named generalized orthogonal components regression (GOCRE), to explore the relationship between a categorical outcome and a set of massive variables. A set of orthogonal components are sequentially constructed to account for the variation of the categorical outcome, and together build up a generalized linear model (GLM). This algorithm can be considered as an exten...
متن کاملHigh - Dimensional Generalized Linear Models and the Lasso
We consider high-dimensional generalized linear models with Lipschitz loss functions, and prove a nonasymptotic oracle inequality for the empirical risk minimizer with Lasso penalty. The penalty is based on the coefficients in the linear predictor, after normalization with the empirical norm. The examples include logistic regression, density estimation and classification with hinge loss. Least ...
متن کاملOptimal Estimation of Co-heritability in High-dimensional Linear Models
Co-heritability is an important concept that characterizes the genetic associations within pairs of quantitative traits. There has been significant recent interest in estimating the co-heritability based on data from the genome-wide association studies (GWAS). This paper introduces two measures of co-heritability in the highdimensional linear model framework, including the inner product of the ...
متن کاملOptimal Estimation of Genetic Relatedness in High-dimensional Linear Models
Estimating the genetic relatedness between two traits based on the genome-wide association data is an important problem in genetics research. In the framework of high-dimensional linear models, we introduce two measures of genetic relatedness and develop optimal estimators for them. One is genetic covariance, which is defined to be the inner product of the two regression vectors, and another is...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the National Academy of Sciences
سال: 2019
ISSN: 0027-8424,1091-6490
DOI: 10.1073/pnas.1802705116